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Heterogeneity in oscillator networks: Are smaller worlds easier to synchronize? 
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Small-world and scale-free networks are known to be more easily synchronized than regular lat- 
tices, which is usually attributed to the smaller network distance between oscillators. Surprisingly, 
we find that networks with a homogeneous distribution of connectivity are more synchronizable than 
heterogeneous ones, even though the average network distance is larger. We present numerical com- 
putations and analytical estimates on synchronizability of the network in terms of its heterogeneity 
parameters. Our results suggest that some degree of homogeneity is expected in naturally evolved 
structures, such as neural networks, where synchronizability is desirable. 
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In their seminal work, Watts and Strogatz []J, |2( 
have shown that real networks of different nature have 
the small-world (SW) property, characterized by high 
clustering and the average network distance between 
two nodes that is as small as pure random networks. 
Since then, many more examples of real-world net- 
works H 0, H H @, including both artificial and 
natural systems, have been identified to have the SW 
property. It turns out, however, that there is another 
seemingly generic feature of networks in the real world. 
It is called the scale-free (SF) property, which is signified 
by the power-law connectivity distribution of the net- 
work 11 SIlllElElElElIIi. Barabasi and Al- 
bert |l| suggested a model of growing networks, in which 
preferential attachment of new links to nodes with higher 
connectivity results in the SF property. There has also 
been some efforts to incorporate both SF and SW prop- 
erties in a single model 0, 0, 0] . 

So far, much research has been focused on the struc- 
tural properties of SF and SW network models. Despite 
the widespread belief that these structural properties 
must have significant impact on dynamical processes tak- 
ing place on such networks || , there has been little work 
directly addressing this issue. Most work has dealt with 
synchronization of oscillators whose topology of interac- 
tion has either the SF or S W 0, [H GJ, [H [M EJ |H 
property, showing that it leads to improved synchro- 
nizability when compared to local lattice topology. A 
general argument underlying this phenomenon is that 
communication between oscillators are more efficient be- 
cause of the smaller average network distance. But, does 
smaller average network distance improve synchronizabil- 
ity? 

For many real networks, heterogeneity is a common 
trait which frequently manifests itself in the form of an 
SF distribution of connectivities. It is known that such 
heterogeneity tends to reduce the average network dis- 
tance |24|, and this leads naturally to the question of 



whether heterogeneity improves synchronizability. 

The aim of this paper is to demonstrate, by using im- 
portant classes of SF and SW network models, that het- 
erogeneity of the connectivity distribution causes the op- 
posite to hold; namely, as heterogeneity increases, the 
average network distance is reduced but synchronization 
becomes more difficult to achieve. We show that this in- 
triguing behavior can be explained by examining the load 
distribution on nodes or links, where the load of a node 
(or a link) quantifies the traffic of communication pass- 
ing through it. The analytical results we derive suggest 
that our observations are quite general and are expected 
to hold for a wide class of complex networks. 

Synchronizability of a network of oscillators can be 
quantified through the eigenvalue spectrum of the Lapla- 
cian matrix representing the connection topology of the 
network. Here we follow the general framework estab- 
lished in jH |il|. Consider a network of N identical 
dynamical systems with symmetric coupling between os- 
cillators. The equations of motion for the system are 

N 

x i = F{x i )+aY^L i jH{x j ), i = l,...,N, (1) 

where x = F(x) governs the dynamics of each individ- 
ual node, H(x) is the output function, a is the overall 
strength of coupling, and L is the Laplacian matrix, de- 
fined to be Lij = — 1 if nodes i and j are connected, 
La = ki if node i is connected to ki other nodes, and 
= otherwise. The linear stability of the synchro- 
nized state {xi(t) = x*(i),Vi} is determined by the cor- 
responding variational equations, which can be diagonal- 
ized into N blocks of the form y — [DF(s) + XDH(s)]y, 
where y represents different modes of perturbation from 
the synchronized state. We have A = aXi for the ith 
block, i — 1,2, ... ,N, and Ai = < A2 < . . . < \n are 
the eigenvalues of L The largest Lyapunov expo- 

nent A(A) for this equation, also called the master sta- 
bility function [23 > determines the linear stability of the 
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synchronized state for any linear coupling scheme. In 
particular, the synchronized state is stable i f A( a\, ■ ) < 0, 
for each i = 2, . . . , N [27J . It was found |25| that for 
a large class of chaotic oscillatory systems, there exists 
a single parameter interval (01,0^2) on which A(A) < 0. 
In this case, there is a value of the coupling strength a 
for which the synchronized state is linearly stable, if and 
only if < 012/0.1 = /3, where (3 is a constant that 

depends on F(x), x*(t), and H(x), but not on L. The 
value of /3 ranges from 5 to 100 for various chaotic os- 
cillators [2^ ■ Realizing that the ratio depends 
only on the topology of interactions among oscillators, 
we see that the impact of having a particular coupling 
topology on the network's ability to synchronize is rep- 
resented in a single quantity Ajv /A2: the larger the ratio, 
the more difficult it is to synchronize the oscillators, and 
vice versa |22j. 

Having reduced the problem of synchronizability to 
finding eigenvalues of the Laplacian matrix L, we now 
study the effect of heterogeneity in the connectivity dis- 
tribution. We first consider the semirandom model of 
SF networks 0] , where the connectivity ki > kg of each 
node i is chosen at random according to the probability 
distribution P(k) ~ k~ 7 with the scaling exponent 7. 
An SF network is then generated by randomly connect- 
ing nodes, forcing each node i to have connectivity fci, 
and prohibiting self- and repeated links 0, |2^ ■ 

The average network distance T> of an SF network de- 
creases with increasing heterogeneity of the connectivity 
distribution, where T> is defined as the minimum number 
of links that must be followed to go from one node to an- 
other, averaged over all pairs of nodes. Figure^a) shows 
the dependence of V on the scaling exponent 7 for the 
semirandom model. In order to quantify the heterogene- 
ity of the connectivity distribution, we plot its standard 
deviation s in the inset of Fig. da). We observe that 
smaller values of 7 result in a longer tail in the connec- 
tivity distribution, which in turn makes s larger. Note 
that for completely homogeneous case of 7 = 00, which 
corresponds to taking ki = fco for all i, we have s = 0. 
Note also that decreasing 7 increases the average connec- 
tivity k as well, which can be seen in the same inset. This 
implies that the total number of connections increases. In 
short, the more heterogeneous the network is, the more 
connected and "smaller" it is. 

Since the SF and SW networks are known to show en- 
hanced synchronizability over lattices, one might expect 
that an SF network with smaller T> would have improved 
synchronizability. However, we observe the opposite phe- 
nomenon: the ratio increases as 7 is increased, 
as shown in Fig. ^b). In other words, as the network 
becomes more heterogeneous, it becomes less synchroniz- 
able, even though k gets larger and T> gets smaller [29j |. 

The heuristic reason for this surprising behavior lies in 
the fact that a few "center" oscillators interacting with a 
large number of other oscillators tend to get overloaded 
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FIG. 1: Synchronizability of SF networks of size N = 2 10 . 
(a,b) The average network distance T> and the eigenvalue ra- 
tio Ajv/A2 for the semirandom model with ko = 5. The in- 
set of (a) shows the mean k and the standard deviation s 
of the connectivity distribution. The maximum £ max of the 
normalized load on nodes is plotted in the inset of (b). The 
horizontal lines in (a) and (b) indicate the values of V and 
Xn/X2 computed for the 7 = 00 case. (c,d) The same quan- 
tities for the growing model with aging of nodes for no — 5 
and m a = 5. Note that k is not shown because it is trivially 
k — m a . The solid curves in (b) and (d) are the lower bounds 
given in Eq. @. The upper bounds of Eq. @ are above the 
limits, but follow the same trend. All quantities are averaged 
over 100 realizations. 



by the traffic of communication passing through them. 
When too many independent signals with different phases 
and frequencies are going through a node at the same 
time, they can cancel one another, resulting in effectively 
no communication between oscillators. Hence, the more 
concentrated the traffic is on a few nodes, the more diffi- 
cult it is to achieve efficient communication between os- 
cillators, leading to reduced synchronizability. The same 
effect results from overloading links as well. 

The amount of communication traffic passing through 
node i can be quantified by the load on i, defined as the 
number of shortest paths between two (other) nodes that 
pass through i [ll], yfj . To quantify the extent to which 
the load distribution is concentrated on a few nodes, we 
first normalize the load on each node by the total load 
of the network, and then focus our attention on its max- 
imum value £ max over all nodes. The dependence of £ max 
on 7 is shown in the inset of Fig. ^b). We see that the 
behavior of l max is followed closel y by the ratio Xn/X2- 
This is consistent with the result in .'!() for another model 
of SF networks. It is shown there that £ max for the largest 
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hub scales as N~ s , where the scaling exponent 5 w 0.2 
for 2 < 7 < 3, but S gets larger as 7 > 3 is increased. 
This means that for a fixed N, more heterogeneous con- 
nectivity distribution implies more heterogeneous load 
distribution on nodes. 

To illustrate the prevalence of this phenomenon, we 
next consider a growing model of SF networks with ag- 
ing of nodes [3l| . In this model, the network initially has 
no nodes. At each time step, a new node with m a links 
is added. The probability for an existing node i to re- 
ceive a link from the new node is proportional to ki and 
t~° , where 7$ is the age of node i, or the number of time 
steps since it was added to the network. It was shown 
in |3l| that the parameter a determines the scaling ex- 
ponent 7 for the resulting SF network, and that smaller 
a (< 1) yields smaller 7 (> 2). Figures GIc,d) show the 
result for the growing model, from which one observes 
the same phenomenon of reduced synchronizability due 
to heterogeneity. 

To show that any type of heterogeneity induces the 
same behavior, we now introduce a variant of the SW 
model 0, which is constructed as follows. First we start 
with a regular one-dimensional lattice having N nodes 
with connections up to Kth nearest neighbors. We next 
choose n c nodes at random from all nodes with equal 
probabilities, and assign them to be centers, or hubs. Fi- 
nally, we add each of m shortcuts by connecting one node 
chosen at random from all N nodes to another node ran- 
domly chosen from the n c center nodes. We call this the 
two-layer SW model since nodes can be naturally divided 
into two groups: centers, which tend to have higher con- 
nectivity, and the others that have lower connectivity. 
Thus, the heterogeneity is controlled by the parameter 
n c : small n c leads to higher connectivity of the centers, 
which in turn results in increased heterogeneity. 

Two extreme cases in our model exhibit interesting 
features. When n c = N, shortcuts are simply added 
uniformly at random, effectively reducing the network to 
the homogeneous SW model of Watts and Strogatz [lj, 
l32j |. If n c = 1, all shortcuts are connected to a single 
center, making the configuration close to the one which 
minimizes the average network distance T> [33L l3*i| . 

The network exhibits a stronger SW property when n c 
is smaller, i.e., when the network is heterogeneous. As 
can be seen in Fig. Ufa) , decreasing n c reduces D and in- 
creases the clustering coefficient C, where C is defined as 
the probability that two nodes are connected, given that 
they are connected to a third common node |2|. How- 
ever, the stronger SW property has a counter-intuitive 
effect on synchronizability: as the network becomes more 
heterogeneous (and its SW property stronger), the ratio 
increases sharply (up to a factor of about 50), in- 
dicating that it becomes more difficult to synchronize the 
oscillators. It is interesting to compare this with the re- 
sult of [2^], in which the network was never observed to 




FIG. 2: (a) The average network distance T>, the cluster- 
ing coefficient C, and (b) the ratio Ajv/A2 for the two-layer 
model. The inset in (b) shows the maximum value £ max of 
the normalized load on nodes. The solid curves in (b) are 
the bounds given in Eq. @. All estimates are the results of 
averaging over 100 realizations, and T> and C are normalized 
by the respective values for n c = N: T> « 4.6 and C ~ 0.52. 
Other parameters are N — 2 10 , k = 4, and m = 2 9 . 

become less synchronizable when T> decreases pjjj ]. 

In fact, for N 3> 1 and m = N — 2k — 1, one can 
show [3(| that V scales as ~ In AT for n c = N, while it is 
almost a constant for n c = 1. However, this is achieved 
by having almost half of the total load on a single giant 
center node, and, as a result, scales as ~ N for 

n c = 1, in sharp contrast to bounded behavior for n c = 
N, making it difficult for the oscillators to synchronize. 

The generality of the correlation between homogeneity 
and synchronizability can be seen in the rigorous bounds 
on the ratio Ajy /A2 that are valid for any connected net- 
work j3r3 |: 

(1 - i) ^ < ^ < (N - (2) 

where fc m j n and fc max are the minimum and maximum 
connectivity, £> max is the maximum length of the shortest 
path between two nodes and is the maximum of the 
normalized loads on links (edges), similarly defined as for 
those on nodes. While is larger for heterogeneous 

networks because fc max /fcmin is larger, homogeneous net- 
works have smaller ratios Xn/M because fc max and ^ ax 
are smaller. However, it is the combination of network 
distances being small (so that £> max 2? is small) and the 
distributions of connectivities and loads being homoge- 
neous that makes the network more synchronizable. 

It has been suggested often in neuroscience that 
smaller T> in the nervous system should imply more ef- 
ficient communication between neurons, and therefore 
V might have been minimized (along with other fitness 
functions) by evolution IH, H3- The results here, 
however, suggest that natural selection might have in- 
creased homogeneity in the distribution of connections 
(and hence in the load distribution) at the expense of hav- 
ing larger T>, in order to enhance synchronizability. For 
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example, the neurons in some layers of cortical columns 
are relatively homogeneous in soma size, which has been 
visualized using the Nissl stain technique [iof. Since the 
cell body size of a neuron is correlated with the size of its 
dendritic and axonal expansions |4l| . which in turn cor- 
relate with the number of synaptic connections it receives 
and sends, it appears that neuronal subnetworks within 
cortical layers have relatively homogeneous connectivity. 
The ability of such subnetworks to synchronize facilitates 
their ability to exhibit bursting behaviors that underlie 
neural computations. 

In conclusion, we have shown that the common belief 
that smaller networks have better synchronization prop- 
erty can be misleading for a wide class of networks, such 
as SF and SW networks. Using a general framework for 
synchronization stability of oscillator networks with ar- 
bitrary interaction topology, we have established that SF 
and SW networks will have reduced ability to synchro- 
nize as the heterogeneity of their connectivity distribu- 
tion increases, even though the average network distance 
between the oscillators becomes smaller. Increased con- 
centration of load on center nodes, or hubs, appears to be 
responsible for this behavior. Our results suggest that in 
order for oscillators in a network to communicate better, 
and hence to synchronize more effectively ^3 ; a balance 
between having small communication distance and uni- 
form load distribution is essential. 
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